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DETAILED ACTION 



Response to Arguments 



1. 



Applicant's arguments filed June 27, 2005 have been fully considered but they are not 



persuasive. 



2. 



Applicant argues: 



"The Office Action alleges that the flow chart of the tube in column 8, lines 9- 
13, of Okada teach the claimed obtaining 'processed image data, before shooting 
of a next frame of an image, in which the processed image data is stored in said 
image memory prior to the shooting of the next frame.' Applicant respectfully 
submits that Yokota fails to teach or suggest this claimed feature. Yokota 
teaches correction of image data based on lens aberrations, however, Yokota 
does not indicate how the data is processed and/or stored in relation to the 
shooting of a next image frame. Fig. 2 of Yokota details the steps for processing 
obtained data. However, it does not illustrate where in the processing step a next 
image frame is captured. The Office Action appears to jump to conclusions not 
based upon facts. The Office Action states 'The flow chart concerns the 
capturing and correcting of a single image prior to permanent storage and, as 
clearly shown, the next frame is captured again at the beginning of the flow 
chart.' See page 7 of the Office Action." 



3. The Examiner disagrees with Applicant's position on the basis that Yokota et al. disclose 
capturing and processing a video signal. More specifically, Yokota et al. teach, as stated in 
column 6 (lines 54 - 57 and 65 - 67), that first image memory (103) is provided for memorizing 
distorted image data obtained from the image sensor (101), that the second image memory (104) 
is provided for memorizing distortion corrected image data, and that the image controlling circuit 
(102) processes the distorted image data into the distortion corrected image data and further 
converts the distortion corrected image data into a video signal. Furthermore, Yokota et al. note, 
in column 7 (lines 1 - 5), that the first image memory (103) memorizes one digital image frame 
(of the video signal comprising a plurality of frames) and that the outputted video signal 



conforms to an NTSC system (30 frames/second). Finally, Yokota et al. recites, in column 7 
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(lines 60 - 62), that the corrected image data is sequentially memorized in the second image 
memory (104). 

4. Based upon the facts recited above, it is clear that Yokota et al. is directed towards a 
standard digital video camera wherein each of the frames of the video signal is distorted upon 
capture such that each distorted frame is corrected in real-time to yield a distortion free video 
signal. Since the first memory is a single frame buffer and distortion processing is performed 
upon reading a video frame from the first memory, to prevent total failure of the video camera 
Yokota et al must operate by processing distorted image data either before a shooting of a next 
frame or during the shooting of the next frame. 

5. Applicant further argues: 

"The office action alleges that column 4, lines 50-56 teaches that the correction 
performed by the lens characteristic correction unit (Fig. 2) involves 
interpolation between adjacent picture elements. However, this section of Sekine 
merely explains the interpolation between adjacent picture elements and does 
not describe how to obtain the region larger than the photographic region 
confirmed by the photographer as an image data. Thus, Sekine fails to teach the 
features of claim 7." 

6. The Examiner disagrees with Applicant's position on the basis that the interpolation in 
Sekine involves estimating missing pixel values. More specifically, all interpolation forms new 
pixel values via mathematical equations based upon pixel values adjacent to the missing pixel 
values (or rather new pixel values). In other words, Sekine is increasing the total spatial 
resolution of the originally captured image such that the newly formed image has a larger spatial 
resolution than the originally captured image. Furthermore, it is clear that Sekine is not simply 
directed towards color transformation interpolation because Sekine specifically states that the 
interpolation is performed " between adjacent picture elements ." A further example can be found 
in figure 3 wherein the memory addresses of each of the distorted image elements that follows 



Application/Control Number: 09/330,096 Page 4 

Art Unit: 2612 

the distortion curve (42) are corrected such that said image elements follow the linear curve (44) 
and the missing picture elements (those missing due to the shown barrel type distortion) are 
interpolated to fill in the gaps. 

Claim Rejections - 35 USC § 103 

7. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set forth in 
section 102 of this title, if the differences between the subject matter sought to be patented and the prior art are 
such that the subject matter as a whole would have been obvious at the time the invention was made to a person 
having ordinary skill in the art to which said subject matter pertains. Patentability shall not be negatived by the 
manner in which the invention was made. 

8. Claims 1 - 11 are rejected under 35 U.S.C. 103(a) as being unpatentable over Sekine et 
al. in view of Yokota et al. 

9. For Claim 1, Sekine et al. disclose, as shown in figures 1 and 2, a digital image shooting 
device, comprising: 

an image forming zoom lens (zoom lens 12); 

an image sensor element (solid-state image sensors 14, 16, and 18); 

a data processing unit for processing an output signal from said image sensor element 
(14, 16, and 18) into digital image data (see detailed explanation below); 

an image memory (video tape) for storing the digital image data (color video output) and 
a lens characteristic (aberration information code) relating to the image forming lens (zoom lens 
12; again see detailed explanation below); 

a lens characteristic correction unit (figure 2 and as stated in column 4, lines 9-13 and 
18-27) for performing, by using the stored lens characteristic of said image forming lens and a 
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position of a frame image photographed (stored in the video tape), a process of correcting a 
position of a frame image photographed (by means of image memory 38), a process of correcting 
a deterioration of an image quality derived from said image forming lens upon the entire digital 
image data (by means of computing circuit 40). 

In regard to the data processing unit, Sekine et al. is silent with regard to a data 
processing unit for generating digital image data, however, a video signal processing circuit (20) 
is provided, which performs known processes on the outputs of the image sensor element. A 
recording circuit (22) records the color video output of the video signal processing circuit (20) on 
a video tape together with an aberration information code which is digitized and provided by a 
ROM (32). Thus, since the aberration information code is recorded together with the color video 
output onto the video tape, it is inherent that either the known processes performed by the video 
processing circuit (20) or the recording circuit (22) at least include a step to digitize the color 
video output. If the color video output were not digitized, it would be impossible to record it 
together with the digitized aberration information code on the video tape. 

In regard to the lens characteristic, Sekine et al. disclose, as stated in column 3 (lines 34 - 
36 and 49 - 67), an aberration information code, which has been digitized by the A/D (30). The 
aberration information provided to the A/D (30) is generated by the potentiometers (24, 26, and 
28) of the zoom lens (12). The potentiometers (24, 26, and 28) detect the object distance, focal 
length, aperture value of the iris of the zoom lens (12), respectively. An A/D (30) is arranged to 
digitize the outputs of the potentiometers (24, 26, and 28). The digitized potentiometer (24, 26, 
and 28) outputs are provided to a digital microcomputer (34), which compares them to tabular 
codes stored in ROM (32) to generate a digital aberration information code to be recorded with 
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the color video output, on a video tape, in the recording circuit (22). Therefore, for each new 
object distance, focal length, and/or aperture value of the iris of the zoom lens (12), a new 
aberration information code is generated and recorded together with the color video output. 

Lastly, Sekine et al. teach that the process of correcting image quality does not have to be 
carried out in real time. Therefore, Sekine et al. does not disclose a process of correcting image 
quality wherein the image data is processed then stored in an image memory prior to capturing 
the next image or in an alternative mode, the image data is processed while at the same time 
image shooting device captures another image and the processed image data is either stored in 
the image memory during the capturing of the image or directly thereafter. 

On the other hand, Yokota et al. also disclose a digital image shooting device that is 
concerned with correcting image quality. More specifically, Yokota et al. teach, as stated in 
column 6 (lines 54 - 57 and 65 - 67), that first image memory (103) is provided for memorizing 
distorted image data obtained from the image sensor (101), that the second image memory (104) 
is provided for memorizing distortion corrected image data, and that the image controlling circuit 
(102) processes the distorted image data into the distortion corrected image data and further 
converts the distortion corrected image data into a video signal. Furthermore, Yokota et al. note, 
in column 7 (lines 1 - 5), that the first image memory (103) memorizes one digital image frame 
(of the video signal comprising a plurality of frames) and that the outputted video signal 
conforms to an NTSC system (30 frames/second). Finally, Yokota et al. recites, in column 7 
(lines 60 - 62), that the corrected image data is sequentially memorized in the second image 
memory (104). 
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Based upon the facts recited above, it is clear that Yokota et al. is directed towards a 
standard digital video camera wherein each of the frames of the video signal is distorted upon 
capture such that each distorted frame is corrected in real-time to yield a distortion free video 
signal. Since the first memory is a single frame buffer and distortion processing is performed 
upon reading a video frame from the first memory, to prevent total failure of the video camera 
Yokota et al. must operate by processing distorted image data either before a shooting of a next 
frame or during the shooting of the next frame. 

As stated in column 1 (lines 43 - 60) of Yokota et al, at the time the invention was made, 
it would have been obvious to one with ordinary skill in the art to have included a process of 
correcting image quality wherein the image data is processed then stored in an image memory 
prior to capturing the next frame, as taught by Yokota et al., in the digital image shooting device, 
disclosed by Sekine et al., for the advantage of reducing computing processing, reducing 
computing processing time, and reducing circuit complexity. 

10. As for Claim 2, Sekine et al. disclose wherein said image quality deterioration further 
includes a distortion aberration (see said detailed explanations in regards to Claim 1 above). 

11. As for Claim 3, Sekine et al. disclose a digital image shooting device according to Claim 
1 wherein the lens correction unit (figure 2) corrects the deterioration of the image quality. 
However, Sekine et al. is silent with respect to a process of compressing the digital image data. 

Official Notice is taken that both the concepts and advantages of compressing the digital 
image data are well know and expected in the art. Since, at the time the invention was made, 
loss less compression is impossible, it would have been obvious to compress the corrected digital 
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image data to prevent deterioration of the aberration information code and further deterioration 
of image quality. 

12. As for Claim 4, Sekine et al. disclose the digital image shooting device according to 
Claim 1 wherein the lens characteristic unit (figure 2) performs correction before the 
photographing of a next frame or during the photographing of the next frame onward. Sekine et 
al disclose a digital image shooting device that operates in real time with the option of operating 
the digital image shooting device not in real time, as indicated in column 4 (lines 64 - 66). Also 
Sekine et al. disclose, as stated in column 6 (lines 13-18), that the digital image data (color 
video output) of the frame that performed the correction by the lens characteristic unit (figure 2) 
is stored in said image memory (video tape). 

13. As for Claim 5, Sekine et al. disclose the digital image shooting device according to 
Claim 1, wherein said image memory is a built-in image recording medium or a removable 
image recording medium (see column 3, lines 13-15). 

14. As for Claim 6, Sekine et al. disclose the digital image shooting device according to 
Claim 1, further comprising an image display unit (see figure 2) for displaying the photographed 
image, wherein an image based on the digital image data which is or is not performed the 
correction process in said lens characteristic correction unit (see figure 2), is displayed on said 
image display unit, and the digital image data performed the correction process in said lens 
characteristic correction unit (see figure 2), is stored in a memory (image memory 38). 

15. As for Claim 7, Sekine et al. disclose the digital image shooting device according to 
Claim 1 wherein an image of a region larger than a photographic region confirmed by a 
photographer is formed on said image sensor element (14, 16, and 18) in accordance with 
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missing of pixels which is caused as a result of the correction by said lens characteristic 
correction unit (figure 2). As stated in column 4 (lines 50 - 56), the correction performed by the 
lens characteristic unit (figure 2) involves interpolation between adjacent picture elements. 

16. As for Claim 8, Sekine et al. disclose a single image formation lens (zoom lens 12) with 
potentiometers (24, 26, and 28). The potentiometers (24, 26, and 28) detect the object distance, 
focal length, aperture value of the iris of the zoom lens (12), respectively. An A/D (30) is 
arranged to digitize the outputs of the potentiometers (24, 26, and 28). The digitized 
potentiometer (24, 26, and 28) outputs are provided to a digital microcomputer (34), which 
compares them to tabular codes stored in ROM (32) to generate a digital aberration information 
code to be recorded with the color video output, on a video tape, in the recording circuit (22). 
Therefore, for each new object distance, focal length, and/or aperture value of the iris of the 
zoom lens (12), a new aberration information code is generated and recorded together with the 
color video output. Since, Sekine et al. disclose the generation of the aberration information 
code from the aberration information of three potentiometers (24, 26, and 28) and the tabular 
codes provided in ROM (32), at the time the invention was made, one with ordinary skill in the 
art would have been motivated to include a plurality of image forming lenses, rather than a single 
image forming lens, wherein each image forming lens is provided with three potentiometers to 
provide aberration information to the ROM (32). Therefore, at the time the invention was made, 
it would have been obvious to one with ordinary skill in the art to have included a plurality of 
image forming lenses. 

17. As for Claim 9, Sekine et al. disclose wherein the lens is a zoom lens (zoom lens 12) and 
the lens characteristic relates to a plurality of focal lengths of the zoom lens wherein the lens 
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characteristics is converted at the plurality of focal lengths to the focal length when the image is 
photographed. 

In regard to the lens characteristic, Sekine et al. disclose, as stated in column 3 (lines 34 - 
36 and 49 - 67), an aberration information code, which has been digitized by the A/D (30). The 
aberration information provided to the A/D (30) is generated by the potentiometers (24, 26, and 
28) of the zoom lens (12). The potentiometers (24, 26, and 28) detect the object distance, focal 
length, aperture value of the iris of the zoom lens (12), respectively. An A/D (30) is arranged to 
digitize the outputs of the potentiometers (24, 26, and 28). The digitized potentiometer (24, 26, 
and 28) outputs are provided to a digital microcomputer (34), which compares them to tabular 
codes stored in ROM (32) to generate a digital aberration information code to be recorded with 
the color video output, on a video tape, in the recording circuit (22). Therefore, for each new 
object distance, focal length, and/or aperture value of the iris of the zoom lens (12), a new 
aberration information code is generated and recorded together with the color video output. 
1 8. For Claim 10, Sekine et al. disclose a digital image shooting device, comprising: 

an image forming lens (zoom lens 12); 

an image sensor element (solid-state image sensors 14, 16, and 18) optically coupled to 
said lens; 

a data processing unit connected to said image sensor element (14, 16, and 18) and 
receiving an output signal from said image sensor element (14, 16, and 18) and converting the 
output signal into digital image data (see detailed explanation below); 

an image memory (video tape) connected to said data processing unit, the digital image 
data (color video output) and a lens characteristic (aberration information code) relating to the 
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image forming lens (zoom lens 12) being stored in said image memory (video tape; again see 
detailed explanation below); 

a lens characteristic correction unit (figure 2 and as stated in column 4, lines 9—13,18 — 
27, and 50 - 56 and column 6, lines 31-36) connected to said image memory (video tape), said 
lens characteristic correction unit (figure 2) correcting a deterioration of an image quality derived 
from said image forming lens (zoom lens 12) upon the digital image data (color video output) by 
using the stored lens characteristic of said image forming lens (zoom lens 12) and a position of a 
frame image photographed (stored in the video tape); 

wherein the image quality deterioration corrected by the lens characteristic correction 
unit (figure 2) is a distortion aberration and a chromatic aberration of magnification (see notes 
above). 

In regard to the data processing unit, Sekine et al. is silent with regard to a data 
processing unit for generating digital image data, however, a video signal processing circuit (20) 
is provided, which performs known processes on the outputs of the image sensor element. A 
recording circuit (22) records the color video output of the video signal processing circuit (20) on 
a video tape together with an aberration information code which is digitized and provided by a 
ROM (32). Thus, since the aberration information code is recorded together with the color video 
output onto the video tape, it is inherent that either the known processes performed by the video 
processing circuit (20) or the recording circuit (22) at least include a step to digitize the color 
video output. If the color video output were not digitized, it would be impossible to record it 
together with the digitized aberration information code on the video tape. 
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In regard to the lens characteristic, Sekine et al. disclose, as stated in column 3 (lines 34 - 
36 and 49 - 67), an aberration information code, which has been digitized by the A/D (30). The 
aberration information provided to the A/D (30) is generated by the potentiometers (24, 26, and 
28) of the zoom lens (12). The potentiometers (24, 26, and 28) detect the object distance, focal 
length, aperture value of the iris of the zoom lens (12), respectively. An A/D (30) is arranged to 
digitize the outputs of the potentiometers (24, 26, and 28). The digitized potentiometer (24, 26, 
and 28) outputs are provided to a digital microcomputer (34), which compares them to tabular 
codes stored in ROM (32) to generate a digital aberration information code to be recorded with 
the color video output, on a video tape, in the recording circuit (22). Therefore, for each new 
object distance, focal length, and/or aperture value of the iris of the zoom lens (12), a new 
aberration information code is generated and recorded together with the color video output. 

Lastly, Sekine et al. teach that the process of correcting image quality does not have to be 
carried out in real time. Therefore, Sekine et al. does not disclose a process of correcting image 
quality wherein the image data is processed then stored in an image memory prior to capturing 
the next image or in an alternative mode, the image data is processed while at the same time 
image shooting device captures another image and the processed image data is either stored in 
the image memory during the capturing of the image or directly thereafter. 

On the other hand, Yokota et al. also disclose a digital image shooting device that is 
concerned with correcting image quality. More specifically, Yokota et al. teach, as stated in 
column 6 (lines 54 - 57 and 65 - 67), that first image memory (103) is provided for memorizing 
distorted image data obtained from the image sensor (101), that the second image memory (104) 
is provided for memorizing distortion corrected image data, and that the image controlling circuit 
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(102) processes the distorted image data into the distortion corrected image data and further 
converts the distortion corrected image data into a video signal. Furthermore, Yokota et al. note, 
in column 7 (lines 1 - 5), that the first image memory (103) memorizes one digital image frame 
(of the video signal comprising a plurality of frames) and that the outputted video signal 
conforms to an NTSC system (30 frames/second). Finally, Yokota et al. recites, in column 7 
(lines 60 - 62), that the corrected image data is sequentially memorized in the second image 
memory (104). 

Based upon the facts recited above, it is clear that Yokota et al. is directed towards a 
standard digital video camera wherein each of the frames of the video signal is distorted upon 
capture such that each distorted frame is corrected in real-time to yield a distortion free video 
signal. Since the first memory is a single frame buffer and distortion processing is performed 
upon reading a video frame from the first memory, to prevent total failure of the video camera 
Yokota et al. must operate by processing distorted image data either before a shooting of a next 
frame or during the shooting of the next frame. 

As stated in column 1 (lines 43 - 60) of Yokota et al., at the time the invention was made, 
it would have been obvious to one with ordinary skill in the art to have included a process of 
correcting image quality wherein the image data is processed then stored in an image memory 
prior to capturing the next frame, as taught by Yokota et al., in the digital image shooting device, 
disclosed by Sekine et al., for the advantage of reducing computing processing, reducing 
computing processing time, and reducing circuit complexity. 
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19. As for Claim 11, Sekine discloses wherein the image quality deterioration corrected by 
the lens characteristic correction unit (figure 2) is at least one of a chromatic aberration of 
magnification, defocusing, and a decrease in marginal lumination (see explanation below). 

Chromatic aberration of magnification is caused by a difference in light wavelength. The 
focal length or magnification of a lens varies according to the wavelength of each type of 
incident light. Sekine et al. clearly states, in column 3, that the focal length of the zoom lens (12) 
at the time of shooting the image is included in the aberration information code. Thus, chromatic 
aberration of magnification is corrected. Marginal lumination is a drop in brightness at the edges 
of a photograph. Sekine et al. also clearly states, in column 3, that the aperture value of the iris 
of the zoom lens (12) at the time of shooting the image is included in the aberration information 
code. Thus, marginal lumination is corrected. Distortion aberration is inherent to all lenses. The 
aberration information code includes a plurality of aberration information of the zoom lens (12), 
also as clearly stated in column 3. Thus, as indicated in Sekine et al., in column 6 (lines 31 - 
36), image distortion is corrected in accordance with aberration information which indicates any 
aberration that takes place at the time of shooting wherein image distortion results from the 
aberration of the photo-taking lens (12). Therefore, Sekine et al. corrects for a distortion 
aberration, chromatic aberration of magnification, and marginal lumination. 

Claim 1 1 requires at least one of a chromatic aberration of magnification, defocusing, 
and a decrease in marginal lumination. Thus, since Sekine et al. disclose the correction of 
chromatic aberration of magnification and decrease in marginal lumination, individually and 
combined, as noted above, Sekine et al. disclose at least one of a chromatic aberration of 
magnification, defocusing, and a decrease in marginal lumination. 
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Allowable Subject Matter 

20. Claims 12 and 13 are objected to as being dependent upon a rejected base claim, but 
would be allowable if rewritten in independent form including all of the limitations of the base 
claim and any intervening claims. 

21 . The following is a statement of reasons for the indication of allowable subject matter: 
While the closest prior art including those newly cited (see attached form PTO-892), in 

the very least, teaches correcting chromatic aberrations, distortion aberrations, and marginal 
luminance of an image capturing lens using stored lens characteristic data representing 
characteristics of the image capturing lens, wherein correction of an obtained distorted image is 
carried out in real-time before or during the shooting of a next frame; 

The closest prior art does not teach of fairly suggest wherein the image data comprises 
three primary color-based image data and wherein the correction involves a correction unit that 
calculates a first deviation quantity of a first color-based image data due to the deterioration of 
the image quality, the first color-based image data selected among the three primary color-based 
image data, and calculates second deviation quantities of two color-based image data other than 
the first color-based image data on a basis of the calculated first deviation quantity, the second 
deviation quantities representing relative quantities to the first deviation quantities, and performs 
the process of correcting the deterioration of the image quality using the first deviation quantity 
and the second deviation quantities. 
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Conclusion 

22. THIS ACTION IS MADE FINAL. Applicant is reminded of the extension of time 
policy as set forth in 37 CFR 1.136(a). 

A shortened statutory period for reply to this final action is set to expire THREE 
MONTHS from the mailing date of this action. In the event a first reply is filed within TWO 
MONTHS of the mailing date of this final action and the advisory action is not mailed until after 
the end of the THREE-MONTH shortened statutory period, then the shortened statutory period 
will expire on the date the advisory action is mailed, and any extension fee pursuant to 37 
CFR 1.136(a) will be calculated from the mailing date of the advisory action. In no event, 
however, will the statutory period for reply expire later than SIX MONTHS from the mailing 
date of this final action. 

23. Any inquiry concerning this communication or earlier communications from the 
Examiner should be directed to Justin P Misleh whose telephone number is 571.272.7313. The 
Examiner can normally be reached on Monday through Friday from 8:00 AM to 5:00 PM. 

If attempts to reach the Examiner by telephone are unsuccessful, the Examiner's 
supervisor, Thai Q Tran can be reached on 571.272.7382. The fax phone number for the 
organization where this application or proceeding is assigned is 571.273.3000. 

Information regarding the status of an application may be obtained from the Patent 
Application Information Retrieval (PAIR) system. Status information for published applications 
may be obtained from either Private PAIR or Public PAIR. Status information for unpublished 
applications is available through Private PAIR only. For more information about the PAIR 
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system, see http://pair-direct.uspto.gov. Should you have questions on access to the Private PAIR 
system, contact the Electronic Business Center (EBC) at 866-217-9197 (toll-free). 



JPM 

August 25, 2005 



